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Abstract 

We use combinatorial and generating function techniques to enumerate various sets 
of involutions which avoid 231 or contain 231 exactly once. Interestingly, many of these 
enumerations can be given in terms of /c-generalized Fibonacci numbers. 

Keywords: Restricted permutation; restricted involution; pattern-avoiding permu- 
tation; forbidden subsequence; Fibonacci number 

1 Introduction and Notation 

Let Sn denote the set of permutations of {1, . . . , n}, written in one-line notation, and suppose 
TT G Sn- We say tt is an involution whenever 7r{n{i)) = i for all i, 1 < i < n, and we write 
In to denote the set of involutions in Sn- Now suppose ir E Sn and a E Sk- We say tt 
avoids a whenever vr contains no subsequence with all of the same pairwise comparisons 
as (J. For example, the permutation 214538769 avoids 312 and 2413, but it has 2586 as a 
subsequence so it does not avoid 1243. If tt avoids a then a is sometimes called a pattern 
or a forbidden subsequence and tt is sometimes called a restricted permutation or a pattern- 
avoiding permutation. In this paper we will be interested in permutations which avoid several 
patterns, so for any set R of permutations we write Sn{R) to denote the elements of Sn which 
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avoid every element of R. For any set R of permutations we take Sn{R) to be the empty set 
whenever n < and we take Sq{R) to be the set containing only the empty permutation. 
When R = {tti, 7r2, . . . , Tr^} we often write Sn{R) = S'„(7ri, 7r2, . . . , tt^). We will also be 
interested in involutions which avoid several patterns, so for any set R of permutations we 
write In{R) to denote the set of involutions in Sn{R)- 

In this paper we will encounter several sequences, many of which can be written in terms 
of a particular family of sequences. To define this family of sequences, first fix A; > 0. For 
all n < we set F^^n = 0; we also set i = 1. For all n > 2 we set „ = Yl'i=i Fk,n-i- 
We observe that F2^n is the ordinary Fibonacci number Fn for all n > 0. In view of this, we 
refer to the numbers Fk^n as the k-generalized Fibonacci numbers. We also observe that the 
ordinary generating function for the /c-generalized Fibonacci numbers is given by 

oo 

X iXj lAy • • • tij 

We will also make use of the fact, easily verified by induction, that the number of tilings of 
a 1 X n rectangle with tiles of size 1x1, lx2,...,lxA;is given by for all A; > 1 and 

all n > 0. 

Restricted permutations were first connected with Fibonacci numbers by Simion and 



Schmidt, who showed in [jTO|, Prop. 15] that 



|5n(132,213, 123)1 = (n > 0). 

The present authors generalized this result extensively in 0, where they gave several families 
of sets of restricted permutations which can be counted in terms of /^-generalized Fibonacci 
numbers. For example, the present authors showed in that 

|5.(132,213,/3,,,,e)|= £ E C + c-l)^''-^'"-'^+^' 

k=l ^ ^ k=a+c ^ ^ 

where /3a,fe,c is the permutation in Sa+b+c given by 

(3a,b,c = a + 6 + c, a + 6 + c-l,...,6 + c+ l,c+l,c + 2, ...,6 + c, c, c-1,.. .,2,1. 

In fact, |S'„(132, 213, r)| can be expressed in terms of fc-generalized Fibonacci numbers for 
every r G 5'„(132, 213), as Mansour demonstrated in |0| by expressing the generating function 
for |S'„(132, 213, r)| as a determinant of a matrix of generating functions for various k- 
generalized Fibonacci numbers. 

Although they were initially studied through the Robinson-Schensted correspondence, 
restricted involutions have recently begun to receive attention as objects of study in their 
own right. In Regev provided an asymptotic formula for |/„(12. . .k)\ and showed that 
|/„(1234)| = M„, where M„ is the nth Motzkin number, which may be defined by Mq = 1 and 
Mn = Mn-i + ^^~Q MiMn-i-2 foT u > 1. lu 0] Gessel enumerated /„(12 . . . A;), and Gouyou- 
Beauchamps has given bijective proofs of exact formulas for |/„(12345)| and |J„(123456)|. 
Guibert [|] has established bijections between 1-2 trees with n edges and several sets of 
restricted involutions, including J„(3412) and 1^(4321). This latter bijection leads, by way 
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of the Robinson-Schensted correspondence, to a bijection between 1-2 trees with n edges and 
J„ (1234). Guibert has also given a bijection between vexillary involutions of length n (that 
is, /„(2143)) and /„(1243). More recently, Guibert, Pergola and Pinzani gave a bijection 
between 1-2 trees with n edges and vexillary involutions of length n. Combining all of these 
results, we find that |/„(1234)| = |4(3412)| = |/„(4321)| = |/„(2143)| = |/„(1243)| = M„. 
At this writing it is an open problem to prove the conjecture of Guibert ||^ that |/„(1432)| = 

In this paper we use combinatorial and generating function techniques to enumerate 
various sets of involutions which avoid 231 or contain 231 exactly once. It turns out that 
many of these enumerations can be given in terms of /c-generalized Fibonacci numbers. In 



section 2 we use results of Simion and Schmidt [T^, Mansour 0], and the current authors 
to explain how to enumerate involutions which avoid 231 and another pattern. In section 
3 we enumerate involutions which avoid 231 and contain a given pattern. In section 4 we 
enumerate involutions which contain 231 exactly once and avoid another pattern. In section 
5 we enumerate involutions which contain 231 exactly once and contain another pattern. 



2 Involutions Which Avoid 231 and Avoid Another 
Pattern 

In this section we briefly consider /„(231,r), where r G S^- Our consideration will be 
brief because these sets of permutations have already been extensively studied in a slightly 
different guise. To describe this different guise, we begin with some notation. 

Definition 2.1 Fix n > 1 and let li,l2, ■ ■ ■ Jm denote a sequence such that k > 1 for 
1 < i < m and h = n. We write [/i, • • • , ^m] to denote the permutation given by 

[h,l2, ■ ■ ■ ,lm] = k,h - ■ ■ ■ A,k + h,k + k - I, ■ ■ ■ ,h + I, ■ ■ ■ ,n,n - 1, . . . ,n - lrn + '^- 



) "m ■ 



We call a permutation layered whenever it has the form [/i, . . . , Z^] for some sequence k, . . . ,1 
We remark that layered permutations have also been studied in ||T| and [Q. 
Associating the layered permutation [k, ■ ■ ■ ,lm] with the tiling Ixk, 1 x ^2 , 1 x , • • • , 1 x 
of a rectangle of size 1 x n, we obtain a natural bijection between layered permutations of 
length n and tilings of a 1 x n rectangle with rectangles of size 1 x 1,1 x 2,1 x 3,.... 

Combining the proof of [TO, Prop. 6], the remarks following this proof, and the remarks 



following the proof of [10, Prop. 12], we obtain the following connection between J„(231) 
and layered permutations. 

Proposition 2.2 For all tt G In, the number of subsequences of type 231 in tt is equal to the 
number of subsequences of type 312 in vr. Moreover, for all n > 0, the sets /„(231), /„(312), 
and S'„(231, 312) are all equal to the set of layered permutations of length n. 

It follows from this result that /„(231, r) = S'„(231, 312, r) = /„(312, r) for any permuta- 
tion T. Writing to denote the permutation obtained by writing the entries of r in reverse 
order, we find that S'„(231, 312, r) = S'„,(132, 213, r'') for any permutation r. These obser- 
vations allow us to translate results such as (0) into enumerations of /„(213,r) for various 
permutations r. 
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3 Involutions Which Avoid 231 and Contain Another 
Pattern 



In this section we consider those involutions in /„(231) which contain a given pattern r. We 
begin by setting some notation. 

Definition 3.1 For all n > 0, all r > 0, and all permutations r, we write /^(231|r) to 
denote the set of involutions in /„(231) which contain exactly r subsequences of type r. We 
write 21^ (x) to denote the generating function given by 



2t;(x) = ^|j;(231|r)|x". 

?i=0 

We write ^r{x,y) to denote the generating function given by 

oo oo 

2t.(x,2/) = J]J]|/;(231|r)|xV. 



n=0 r=0 



In view of Proposition 2^, if r is not layered then y) = 0, so it is reasonable to ask 
for a closed form expression for 21,- (x,?/) for any layered permutation r. Such an expression 
appears to be difficult to obtain, so we content ourselves here with a closed form expression 
for ^k...2i{x,y). 

Theorem 3.2 For all k > 1, we have 

^k...2i{x,y) = ^ 7-Y- (3) 



Proof. To obtain , we count tilings of a 1 x r?, rectangle with tiles of size lxl,...,lx(A; — 1) 
according to the length of the right-most tile. The generating function for the empty tiling 
is 1. The generating function for those tilings whose right-most tile has length j > 1 is 
2;i^(fc)2t;j, 2i(a^,2/)- Combining these observations, we find that 

2lfc...2i(a;,?/) = 1 + ^x^?/('*)2tfe..,2i(x,2/). 

i>i 

Solve this equation for ^k...2i{x,y) to obtain (|). □ 

For r < k one can now obtain 21'^ 21 (^) fro^i by expanding the right side in powers 
of y and finding the coefficient of y''. In lieu of this calculation, we use a combinatorial 
approach to obtain 21^. 2i(-^)- 

Theorem 3.3 For all k and r such that < r < k and all n > we have 

r 

|/;(231|fc...21)|= l[Fk.^,s^^„ (4) 

So,...,Sr i = 
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where the sum on the right is over all sequences sq, . . . ,Sr of nonnegative integers such that 
Yll=o Si = n — kr. Moreover, 

Proof. Since r < k, the tilings which correspond to the permutations in /^(231|A; . . . 21) are 
exactly those tilings of a 1 x rectangle which contain precisely r tiles of size 1 x A; and no 
tiles of length + 1 or more. To build such a tiling, first order the tiles of size 1 x A;; there is 
one way to do this. Now fix the sizes Sq, Sr of the gaps between these tiles; observe that 
we must have Yll=o — ^ ~ Finally, tile each of these gaps with tiles of length at most 
/c — 1; there are 111=0 -^fc-i,Si+i ways to do this. Combine these observations to obtain (^). 
The proof of (^) is similar to the proof of (^). □ 

Using the same combinatorial techniques, we now compute for any layered permu- 

tation r. 

Theorem 3.4 Fix a layered permutation [li, ...,/„]• Set ko = h — 1, km = Im — 1, (^nd 
ki = min(/i — 1, li^i — 1) for 1 < i < m — 1. Then we have 

m 

|/^,(231|[/i,..., /„])!= n^^».^-+i' (6) 

So,...,Sm i = 

where the sum is over all sequences of nonnegative integers such that Yl^o = n — 'Y^Li 
Moreover, 

Proof. This is similar to the proof of Theorem p.3| . □ 



Using Theorem we now highlight a family of involutions which are enumerated by 
fc-generalized Fibonacci numbers. 

Corollary 3.5 For all k > 1, all I > 1, and all n > 0, the number of involutions in /„(231) 
which contain exactly one subsequence of type [l'',l] is given by Fi^i^n~k-i+i- 



Proof. Set m = A; + 1, = 1 for 1 < z < A;, and Ik+i = I in Theorem p.4| and observe that 
Fo 1 = 1 and Fq „ = whenever n 7^ 1 . □ 



4 Involutions Which Contain 231 Once and Avoid An- 
other Pattern 

In this section we consider those involutions in /„ which contain exactly one subsequence of 
type 231 and avoid an additional pattern. We begin by setting some notation. 
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Definition 4.1 For all n > and any permutation r, we write C„(t) to denote the set of 
involutions in In which avoid r and which contain exactly one subsequence of type 231. We 
write Cr(a^) to denote the generating function given by 

oo 

(ir{x) = J2\Cn{r)\x\ 
n=0 

As we did for /„(231) in Section H, we give a constructive bijection between the set of 
involutions of length n which contain exactly one subsequence of type 231 and a certain set 
of tilings of a rectangle of size 1 x n. 

Proposition 4.2 Fix n > 0. Then there exists a constructive bijection between the set of 
involutions in In which contain exactly one subsequence of type 231 and the set of tilings of 
alxn rectangle using exactly one red rectangle of size 1x4 and blue rectangles of size 1x1, 
1x2,.... 

Proof. Suppose we are given such a tiling; we construct the corresponding involution as 
follows. First number the squares 1, 2, . . . , n from left to right. In each blue tile, reverse the 
order of the entries. If the left-most entry of the red tile is a, then put the entries of the red 
tile in the order a + 3,a + l,a + 2,a. It is routine to verify that the resulting permutation 
is an involution which contains exactly one subsequence of type 231 and that the given map 
is injective. Therefore it is sufficient to show that the given map is surjective. To do this, 
fix TT G /„; we argue by induction on n. It is routine to verify the result when n < 4, so we 
assume n > 5 and that the result holds for all k < n — 1. Fix j such that 7r(j) = n; since 
TT is an involution we also have n{n) = j. We consider two cases: either n appears in the 
subsequence of type 231 or n does not appear in the subsequence of type 231. 

If n does not appear in the subsequence of type 231 then there exist permutations tti and 
7i2, exactly one of which contains exactly one subsequence of type 231, such that tt = tti, ra, #2- 
Here 7F2 is the sequence obtained by adding j — 1 to every entry of In this case the result 
follows from our bijection involving /„(231) and induction. 

Now suppose the subsequence given by 7r(a), n, 7r(6) has type 231. If 7r(6) > j then 
7r(a) > 7r(6) > j and the subsequence 71(0), n,j of tt is a second subsequence of type 231, 
which is a contradiction. If 7r(6) = j then 7r(a) > j. Therefore, since vr is an involution, a 
appears to the right of n and a < 7r(a). It follows that 7r(a), n, a is a second subsequence of 
type 231, which is a contradiction. If 7r(6) < j then b appears to the left of n, since n is an 
involution. It follows that b, n, j is a second subsequence of type 231, which is a contradiction. 
Combining these observations, we find that n does not appear in the subsequence of type 
231. 

It follows that the given map is surjective, as desired. □ 

Using Proposition [4.2| , we now enumerate those involutions in J„ which contain exactly 
one subsequence of type 231. 

Theorem 4.3 The number of the involutions in Sn which contain exactly one subsequence 
of type 231 is given by [n — 1)2"~^ for all n > 5. 

Proof. Count the corresponding tilings in three cases: the red tile is at the far left, the red 
tile is at the far right, or there are blue tiles on both sides of the red tile. There are 2"~^ 
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tilings of the first type, 2" ^ tilings of the second type, and Yl^=i 2* ^2" * ^ = {n — 5)2"" 
tilings of the third type. Combine these observations to obtain the desired result. □ 



We now use Proposition [4.2| to enumerate C„(fc . . . 21). We observe that every involution 
in Sn which contains exactly one pattern of type 231 contains a pattern of type 4231, and 
therefore a pattern of type 321. With this in mind, we consider Cn{k . . . 21) for k > 4. 

Theorem 4.4 Fix k > 4. Then for all n > we have 



n-4 

\Cn{k . . . 21)1 = Fk-lA+lFk-l,n~i-3- 



i=0 

Moreover, 



4 

X 



Proof. This is similar to the proof of Theorem p.3| , using Proposition [4.2| . □ 

We conclude this section by giving a recursive procedure for computing €r{x) when r is 
a layered permutation. 

Theorem 4.5 Fix positive integers li, . . . ,lrn o,nd I. If I < 3 then we have 
// / > 4 then we have 



Proof. This is similar to the proof of Theorem 3.3, using Proposition [4.2|. □ 



We remark that it is clear from results given in [0 and (|^) - (|TT]) that for any layered 
permutation r, the set Cn{T) can be enumerated in terms of fc-generalized Fibonacci numbers. 



5 Involutions Which Contain 231 Once and Contain 
Another Pattern 

In this section we consider those involutions in /„ which contain exactly one subsequence of 
type 231 and which also contain a given pattern. We begin by setting some notation. 

Definition 5.1 For all n > 0, all r > 0, and any permutation t, we write C^{t) to denote 
the set of involutions in In which contain exactly one subsequence of type 231 and exactly r 
subsequences of type t. We write ^^{x) to denote the generating function given by 

oo 

C;(x) = ^|C;(r)|x". 

n=0 
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We write (tr{x,y) to denote the generating function given by 



\x-y\ 



n=0 r=0 



As with ^r{x,y), finding a closed form expression for (tr{x,y) is difficult for general r, 
so we content ourselves here with a closed form expression for ^k...2i{x,y). 

Theorem 5.2 For all k > A we have 



^k...2i{x.y) = —2- (12) 



Proof. This is similar to the proof of Theorem p.2| , using Proposition [4.2| . □ 

For r < k one can now obtain 21 (^) from (^) by expanding the right side in powers 
of y and finding the coefficient of y"^. In lieu of this calculation, we use a combinatorial 
approach to obtain ^l 2i{x). 

Theorem 5.3 For all k and r such that < r < k and all n> we have 

r+l 

\C:{k...21)\ = {r + l) n^'^-i-^^+i' (13) 

SO,...,Sr + l i=0 

where the sum on the right is over all sequences Sq, . . . , s^+i of nonnegative integers such 
that Yl\=l Si = n — kr — A. Moreover, 

e (x) - + (14) 



Proof. This is similar to the proof of Theorem p.3| , using Proposition [4.2| . □ 

We conclude the paper by giving a recursive procedure for computing €l-{x) for any 
layered permutation r. 

Theorem 5.4 Fix positive integers li, . . . ,1^ and I. If I <3 then we have 



If I > 4: then we have 

4....,^™,/](^) = + ^%,...,u,/](^)) ■ (16) 

Proof. This is similar to the proof of Theorem p.2|, using Proposition [4.2|. □ 



We remark that it is clear from (|^ and (|T4D - (|l^) that for any layered permutation r 
the set C^(t) can be enumerated in terms of A;-generalized Fibonacci numbers. 
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